Web Survey Bibliography
Satisficing behavior is a widespread hazard in Web surveys because interview supervision is limited in absence of a human interviewer. Therefore, it is important to devise methods which help to identify and to mitigate satisficing. The paper examines whether innovative questionnaire design can be an efficient means to detect satisficing and to reduce measurement error resulting from non-substantial answers, non-differentiation in matrix questions, and speeding. It analyzes to what extent these types of satisficing can be minimized by using three tools suggested in recent research. First, several studies use prompts to reduce the incidence of non-substantial answers. Second, some authors propose alternative designs for matrix questions (so-called scrolling matrix questions) to mitigate response non-differentiation. Third, control questions (or instructional manipulation checks) are intended to identify inattentive respondents.
The statistical analyses rely on data from two Web surveys of respondents from a probability-based and a non-probability online panel, respectively. Each of the design innovations is randomly assigned to half of the sample while the other half of the sample acts as the control group. The results of the experimental manipulations are presented and a multivariate regression model for satisficing behavior is estimated to test whether the design innovations contribute to the explanation of satisficing if we control for respondent characteristics which are predictive of satisficing. The paper concludes with an assessment of the potentials of the three tools to increase data quality and a discussion of their advantages and pitfalls.
Homepage of Conference (Abstract & Programme)
Web survey bibliography - European survey research associaton conference 2013, ESRA, Ljubljana (44)
- The effect of email invitation characteristics and response reluctance on non-response in web forum...; 2013; Petrovcic, A., Lozar Manfreda, K., Petric, G.
- Assessing data quality with time measurements of responses in the Estonian mixed-mode survey experiment...; 2013; Lumiste, K.
- Mixed-mode and the European Social Survey (ESS): evidence from the UK ; 2013; Park, A., Humphrey, A., Agur, M.
- Does Internet Use Improve Surveys?: Studies of Costs, Response Rates and Coverage. ; 2013; Lesser, V. M., Newton, L., Yang, D.
- An Experimental Evaluation of How Mode Sequence for offering Internet, Mail and Telephone Options Affects...; 2013; Finamore, J., Dillman, D. A.
- Survey errors and costs - comparison of mixed-mode and face - to face ESS surveys in Estonia; 2013; Ainsaar, M., Lumiste, K., Lilleoja, L., Roots, A.
- Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable; 2013; Vannieuwenhuyze, J. T. A., Revilla, M.
- Is the Sky Falling? New Technology, Changing Media, and the Future of Surveys; 2013; Couper, M. P.
- Methodological, legal and technical perspectives on the feasibility of web survey paradata in German...; 2013; Sattelberger, S.
- An imputation approach for analyzing mixed-mode surveys; 2013; Kim, J. K., Park, Se., Kim, S. Y.
- Investigating the Bias of Alternative Statistical Inference Methods in Sequential Mixed-Mode Surveys; 2013; Suzer-Gurtekin, Z., Heeringa, S. G., Valliant, R. L.
- Random versus Systematic Error in a Mixed Mode Online-Telephone Survey; 2013; Hox, J., Scherpenzeel, A., Boeve, A., Boeve, A., de Leeuw, E. D.
- Impact of mode design on reliability in longitudinal data; 2013; Cernat, A.
- Mobility and Smartphones: a pilot study of travel data collection among experienced and inexperienced...; 2013; Douhou, S., Scherpenzeel, A.
- Mobile devices a way to recruit hard-to-reach groups? Results from a pilot study comparing desk top...; 2013; Toepoel, V., Lugtig, P. J.
- The Relation of Survey Topic and Participation Behavior. Analyzing Unit Nonresponse using web-generated...; 2013; Zillmann, D., Schmitz, A., Blossfeld, H. P.
- Exploring patterns of academic usage: A Google Scholar based study of ESS, EVS, WVS and ISSP academic...; 2013; Malnar, B.
- Web questionnaires in official population surveys: Do's and don'ts First experiments and impacts...; 2013; Blanke, K.
- Mode effects in Labour Force Surveys - do they really matter?; 2013; Koerner, T.
- Identifying and Mitigating Satisficing in Web Surveys: Some Experimental Evidence; 2013; Rossmann, J.
- Does left still feel right? The optimal position of answer boxes in Web surveys - revisited; 2013; Lenzner, T., Kaczmirek, L.,Galesic, M.
- Latent legitimacy: joint effects of religious orientation on the association between values and acceptance...; 2013; Henseler, A. K., Siegers, P., Beckers, T.
- Identifying Satisficing Respondents in Web Surveys: A Comparison of Different Response Time-Based Approaches...; 2013; Rossmann, J.
- Comparison of quality of web survey and CATI data using unobtrusive response latencies; 2013; Mayerl, J.
- A walking exercise on a tightrope: trying to balance coverage, probabilistic sampling and the costs...; 2013; Poggio, T.
- Comparability of substantive results between modes and incentive conditions in a probability-based telephone...; 2013; Pekari, N.
- Data Collection Method Comparisons for the 2011 Fishing, Hunting, and Wildlife-Associated Recreation...; 2013; Herbstritt, M., Hornick, D.
- Trends in Dutch egalitarian attitudes, 1975-2010: An age-period-cohort analysis; 2013; Meuleman, B., Oorschot, W. V.
- Comparing Questionnaire Pretesting Methods for the 2015 Population and Housing Census of Korea; 2013; Park, Y.
- Mixed Methods in Cognitive Interviewing: An analysis of the Russian version of the Schwartz Value Survey...; 2013; Efremova, M., Panyusheva, T.
- A mixed methods approach to investigate how Cognitive Interviewing findings can improve the validity...; 2013; Padilla, J. L., Miller, K., Loeb, M.
- Validity of Measuring Educational Attainment - Education and Value Orientation in the European Values...; 2013; Ortmanns, V.
- The comparability of Don't Know answers between CATI and CAWI modes; 2013; Pohjanpaa, K., Jarvensivu, M.
- Measuring the same concepts in several modes in the "BIBB/BAuA-Employee-Survey 2011/12" ; 2013; Gensicke, M., Tschersich, N., Hartmann, J.
- Error Prevention through Interviewer Emulation? Introducing questionnaire dialogues in the Norwegian...; 2013; Gravem, D. F.
- Multiple Group Confirmatory and Exploratory Factor Analysis: Exploring Measurement Invariance by Rotational...; 2013; Asparouhov, T.
- BSEM Measurement Invariance Analysis; 2013; Muthen, B. O.
- A mixed-mode survey tackling against an increasing rate of nonresponse; 2013; Jokinen, M.
- Using Eye Tracking Data to Understand Respondent's Processing of Rating Scales; 2013; Kunz, T., Fuchs, M.
- Advancing the field of questionnaire translation - identifying problems, discussing methods, pushing...; 2013; Behr, D., Dorer, B., Van Houten, G
- European Values Study - methodological and substantive applications; 2013; Luijkx, R., Jagodzinski, W.
- The Impact of Culture and Economy on Values and Attitudes; 2013; Duelmer, H., Voicu, M.
- Educational attainment in cross-national surveys: instrument design, data collection, harmonisation...; 2013; Schneider, S.
- Mode Effects in Mixed-Mode Surveys: Prevention, Diagnostics, and Adjustment 1; 2013; de Leeuw, E. D., Dillman, D. A., Schouten, B.